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EgssxMs; 1 " Project Objectives 

• Provide a technical capability to analyze complex interactions in 
complex systems 

- Model human decisions and multi-level interactions 

- Address client needs that we can not currently support 

- Extend some of our existing, successful work in ontology modeling 

- Develop a reusable solution that is easily transported to multiple client needs 
and extensible within current solution development 

• Apply this new capability to chronic disease research problem 

- Demonstrate the this solution meets National Institute of Health needs 

- Department of Health & Human Services, National Institute of Health, Office of 
Behavioral and Social Sciences Research 

- Show ability to analyze impacts of policy on human lifestyle decisions 
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R & D Approach 

• Research health care policy areas and integrate specific focus area 
data into usable format 

- Based on human decision model 

- Initial focus on human smoking decisions across multiple factors 

• Develop ontology models 

- Human decisions 

- Human environmental entities and relationships 

- Cross-domain ontology model of interactions between humans, environment, 
decisions, and policy 

• Develop Agent Based Model (ABM) and methods 

- Document a Design of Experiment (DOE) method 

- Document an approach to analyze ABM output 
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Health Care Research 


Extensive research has been 
done on individual social risk 
factors that lead to disease 
Risk factors do not act 
independently 
This research allows 
understanding of inter- 
relationships between 

environmental influences and 
social influences on human 
decisions across many risk factors 
Enable inclusion of many risk 
factors across many "layers” 


Global 



• Initial focus on smoking 
risks 
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Health Care Policy Focus Area 

- impact on human decisions 
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Human 

Decisions 


Human 

Behavior 
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Physical Effects 
on Body 
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Capture state transitions 

* Across several risk area "states" 

(smoker, former smoker, non-smoker) 

* Probability (Human Makes a Decision | Given 
Influencing Factor} 
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0ssE!£i*.s? lD Agent Based Simulation 

• Collection of autonomous decision-making entities (agents) 

- NOT intelligent agents or secret agents 

• Allows us to model complexity - multiple system layers and 
complex interactions 

• Discovers “emergent phenomena” 

• Becomes a data source for advanced research 

• Requires sophisticated methods for: 

- Efficient experimental design 

- Data mining 

• Requires computational power 
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ABS Model Characteristics 


U I. bpo 

• Agent characteristics 

- Age. gender, race, smoker? (never, former, current), prob start or quit 

- Maintain smoking status after age 30 

- Life expectancy based on smoking status 

• Population 

- Initially 250 agents 

- Expanded to 1000 agents 

• State-based probability of changes on each tick, modified by Odds 
Ratios (based on interventions) 

- Focus on middle school, high school, and college age 

- Based on informed research using a wide range of journal articles 

- Used chain of conditional probabilities 

• Accounts for peers - social aspect of behavior 


0assK.«?» individuals and States 

• Individuals in the simulation have several attributes that 
describe their state at any given time 

- Smoker or nonsmoker 

- Age 

- Gender 

- Months smoked (total and consecutive) 

• Individuals also retain social relationships which affect 
smoking behavior 

- Parent (single parent, smoking status recorded) 

- Peers (links to “nearby” individuals close to age) 


365 


^MQDSIM WORLD 

f y 1 CoH'fffw:* 4 t»po 


Time Ticks 


• Each month (a “tick” of the simulation clock) an 
individual’s state is updated 

- Age and other tracking variables are incremented 

- Smoking is commenced or ceased based on probabilities 

- In the extended model, an individual may develop disease based 
on probabilities 

• Probabilities of changing states are affected by attributes 
of the individual and their social relationships 

- Parent and peer smoking status affects behavior 

- Age, Gender, prior smoking status has impact on risk 


State Transitions 

• Baseline transition probabilities for the entire population 
are derived from the literature 



Next Month 

Nonsmoker 

Smoker 

This Month 

Smoker 

1.024% 

98.976% 

Monsmoker 

99.513% 

0.487% 


• Baseline probabilities are then adjusted based on 
individual risk factors 

- Literature expresses additional risk as an Odds Ratio (OR) 

- OR > 1 for an attribute means someone with that attribute is more 
likely to change state, OR < 1 means less likely 
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Odds Ratios 


• Simple example 

- Odds of quitting in a month is 1 in 99 (1% chance) 

- If peers smoke, OR is 0.27, which is 3.7 times less likely to quit 

- Odds of quitting are now 0.27 in 99 

• Equivalently, 1 in 99*3.7 

• Combining Odds Ratios 

- Can multiply multiple odds ratios together {e.g., female, high 
school age, peers smoke, exposed to Truth Campaign) 

- For computational efficiency, take log(OR) and add 

- To combine multiple estimates of the same OR, from different 
literature sources, use least squares regression on log(OR) 

- For any given individual state, add up log(OR) of applicable risk 


* Various types of intervention programs (factors) 

- ASPIRE: Computerized smoking prevention curriculum: school-based self-study 

- ESFA: European Smoking prevention Framework Approach: integrated classroom with 
teacher, advertising, journalism 

- ASSIST: A Stop Smoking in Schools Trial - school based, peer-led 

- PPBI; Pediatric Practice-Based intervention - healthcare provider and peer-based 

- National Truth Campaign - Advertising campaign and youth advocacy 

- SCYP: Smoking Cessation for Youth Project 

* Levels (for each intervention) 

- Percent coverage from 0 to 100% 

- Length of interventions, from 0 years to 128 years (evaluated, but no need to 
implement) 

* Responses (% of total population) 

- % Smokers 

- % Former Smokers 


factors 
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Experimental Design 
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Evolution of Design 


3 6 Factorial Design 
729 design points; 12 
hour runtime 


1 x 257 NOLH Design 
257 Design Points 
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6x257 NOLH Design 
(Rotated) 

1542 Design Points 
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Roughly twice as many points as 3 6 factorial with 
huge design space coverage 


Output MOEs 
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Observe social networks 
and behavior: 

Smokers "near" smokers 
less likely to quit 
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Population 
smoking 
distribution by 
age group 


Inputs: 

Multiple combinations of 
coverage policies and 
Interventions programs 
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Initial Analysis Results 


• Multivariate Regression analysis 

- All 6 interventions as dependent variables, with all 2-way interactions 

- Decrease in % smokers as independent variable (positive is good) 

- Expected results: 

* positive coefficients for each intervention 

* Negative coefficients for interactions due to diminishing returns 


- Actual results: 

* SCYP * PPDI positive 

interaction 

* Using both together better 
than each one separately 


Parameter Estimates 


Term 

Estimate 

Std Error 

I Ratio- 

Profa>|t| 

Intercept 

-5.192)25 

0082685 

-82 63 

60000* 

SCYP 

0 4832954 

0.049809 

9 70 

<0001* 

ESFA 

1 4631535 

0.049813 

29.37 

<0001* 

Truin Campaign 

B.331 5739 

9.04991 

127,12 

0.0009* 

ASSIST 

0.4912404 

0.049809 

9.96 

<0001* 

ASPIRE 

5.1580737 

0.049800 

1 03.56 

0.0000* 

PPDI 

1 3071900 

0.049809 

26 24 

<0001* 

$CYP-O.5QO0g*<ASPIRE-0i.&DQQ1 ) 


0,179475 

-3.08 

0 0021* 

(SCYp-o.soooeaTPPDi-o.iMaflj ' 

Q).34aS26S, 

>0.179339 

1.96 

0.0499* 

(E SF A- Q .50009ji T CASPlRE'0.6000l ) 


0.1 59925 

*10.16 

<9001* 

(E 8FA- 0 .5000B)*(PPDI-0. 43999) 

'0.406185 

0.179849 

■2.27 

0 9231* 

(Truth C ampaion- 0 4 995)*(ASPIRE-C. 5000 1 ) 

-1 .115554 

0.179431 

-6.22 

<0001* 

rASSIST-0 49907)*(ASPIRE-0.50001) 

-0.489038 

0,178315 

-2,63 

0 0035* 

^SPIRE-0. 5000 1 nPPOI-O-49099) 

-1.179983 

0178747 

-680 

<0001* 


Sampling of Model Response 


% Smokers 
(pre-interventions) 



*1 Quantiles 


100.0% 

maximum 

44.800 

93.5% 


41 201 

97.5% 


38843 

900% 


35.170 

75.0% 

quail la 

38871 

50.0% 

median 

31.174 

25,0% 

quail la 

28571 

10 0% 


26.210 

2.5% 


23 770 

0.5% 


21 338 

0.0% 

minimum 

15.7SS 


% Smokers 
(post interventions) 
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w Quantiles 


100.0% minimum 

46.748 

99.5% 


41.559 

97.5% 


37.600 

OG.0% 


32 773 

75.D% 

quartile 

27J23 

50.0% 

median 

21 656 

25.0% 

quartiie 

1 5.702 

10 0% 


11 409 

2.5% 


S.434 

05% 


6.024 

0.0% 

minimum 

3.252 


Effects of Interventions 


vs,- ASSIST & 3 mer* 
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(Zooming in on timeframe 
when interventions took 
effect) 




—— Average of %$molrar 
- - - - Goal Achievements 
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Impact of interactions 
on predictions 


* Tested up to 6-way interactions 

- Statistically significant interactions up to 5 th level Predicted 
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A closer look at SCYP 


SCYP shows a clear “threshold effect" 

- PPDI Interaction highlighted this sensitivity to other interventions 

- Minimum and maximum 


invest no more 
than this 


effective level 
Dependent on which other 
interventions are employed 


Invest no less 
than this 


Smoking Cessation 
vs. SCYP Coverage 



20% 60% 80% 

Percent of population exposed lo SCYP 


Potential next steps 

Conference J. Expo ■ 

- just for smoking 

Simulation results used to populate “response surface” 

- Lots of threshold effects for other interventions at various combinations 

• 7-dimensional, so we can’t show you here 

- Given costs of each intervention, along with cost constraints, can use 
optimization methods to find best mix at each investment level 

- Pareto frontier of optimal intervention mixes can inform decisions on 
overall investment level 

Additional simulation exploration of “non-overlapping” multiple 
interventions 

- Each individual might only experience one intervention, but peers may 
experience others 

- Potential to mitigate negative interactions due to “over-intervening” 
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Potential next steps 
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- bigger picture 

• More complex behavior and physical interactions 

- Exercise and food choices impacted by peers 

- All these choices add to risk factors for various diseases 

- Explore impact of “wellness programs” 

• Particularly relevant to analysis of health insurance costs 

• Insurance provider may invest (with potential government subsidy) in 
wellness programs to lower costs (healthier customers) 
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Questions? 
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